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Abstract 

In  daily  conversations,  what  information  do  people  use  to 
assess  their  conversational  partner’s  explanations?  We 
explore  how  a  metacognitive  cue,  in  particular  the  partner’s 
confidence  or  uncertainty,  can  modulate  the  credibility  of  an 
explanation.  Two  experiments  showed  that  explanations  are 
accepted  more  often  when  delivered  by  an  uncertain 
conversational  partner.  Participants  in  Experiment  1 
demonstrated  the  general  effect  by  interacting  with  a  pseudo- 
autonomous  robotic  confederate.  Experiment  2  used  the  same 
methodology  to  show  that  the  effect  was  applicable  to 
explanatory  reasoning  and  not  other  sorts  of  inferences. 
Results  are  consistent  with  an  account  in  which  reasoners  use 
relative  confidence  as  a  metacognitive  cue  to  infer  their 
conversational  partner’s  depth  of  processing. 
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Introduction 

What  makes  an  explanation  believable?  Researchers  have 
recently  discovered  several  conceptual  and  structural 
properties  that  distinguish  credible  explanations  (for 
reviews,  see  Keil,  2006;  Lombrozo,  2006).  Good 
explanations  are  often  relevant  and  informative  (Grice, 
1975;  Wilson  &  Sperber,  2004).  Likewise,  people  appear  to 
prefer  explanations  that  are  simple  (Chater,  1996;  Lagnado, 
1994;  Lombrozo,  2007;  but  cf.  Johnson-Laird,  Girotto,  & 
Legrenzi,  2004),  and  in  situations  of  uncertainty,  they 
appear  to  prefer  explanations  that  have  narrow  latent  scope, 
i.e.,  those  that  account  for  only  observed  phenomena 
(Khemlani,  Sussman,  &  Oppenheimer,  2011).  These 
preferences  show  that  properties  intrinsic  to  the  explanation 
itself  can  cause  individuals  to  judge  the  explanation  to  be 
better,  more  likely,  more  plausible,  and  more  credible. 

However,  individuals  also  rate  explanations  by  appealing 
to  extrinsic  information,  e.g.,  information  about  the  context 
in  which  the  explanation  was  provided  rather  than  the 
material  content  described  by  the  explanation.  Extrinsic 
information  is  particularly  important  when  reasoners  have  to 
evaluate  another  individual’s  explanations.  In  those 
situations,  factors  such  as  the  individual’s  motivation, 
mood,  and  confidence  can  affect  the  believability  of  his  or 
her  explanation.  In  this  paper,  we  focus  on  how  confidence 
can  modulate  an  explanation’s  credibility.  We  first  describe 
confidence  as  a  metacognitive  signal,  and  then  explain  how 
confidence  can  affect  the  believability  of  an  explanation. 
Two  studies  show  that  when  an  agent  appears  uncertain, 
individuals  accept  the  agent’s  explanations  more  often.  We 
discuss  the  phenomenon  in  light  of  intuitive  and  analytic 
reasoning  systems. 


Confidence  and  explanatory  credibility 

Subjective  confidence  is  among  the  most  widely 
investigated  metacognitive  signals  (Dunlosky  &  Metcalfe, 
2009).  In  many  cognitive  tasks  it  is  correlated  with 
accuracy,  though  people  are  often  systematically 
overconfident  about  their  performance  (Lichtenstein, 
Fischhoff,  &  Phillips,  1982;  Lindley,  1982;  McClelland  & 
Bolger,  1994).  Much  of  the  research  on  subjective 
confidence  addresses  how  individuals  integrate  cues  from 
their  task  performance  or  else  their  declarative  knowledge  to 
assess  their  confidence  in  a  particular  decision  of  theirs. 
Confidence  is  often  construed  as  a  signal  predictive  of 
translating  judgments  to  actions  (Dunning,  2007;  Tversky  & 
Koehler,  1994),  and  researchers  have  accordingly  proposed 
many  models  of  how  that  signal  is  constructed  (Albert  & 
Sponsler,  1989;  Erev,  Wallsten,  &  Budescu,  1994;  Ferrell  & 
McGoey,  1980;  Gigerenzer,  Hoffrage,  &  Kleinbolting, 
1991;  Griffin  &  Tversky,  1992;  Juslin,  1994;  Koriat,  2012; 
May,  1986;  Pfeifer,  1994;  Wallsten  &  Gonzales-Vallejo). 

In  daily  interactions  with  others,  people  frequently 
provide  cues  to  their  own  level  of  confidence  for  their 
conversational  partners  to  interpret,  and  they  use  their 
partner’s  cues  to  interpret  the  content  of  their  partner’s 
statements.  Despite  the  prevalent  use  of  confidence  signals 
in  modulating  informational  content,  little  work  has 
established  how  individuals  integrate  cues  to  a  partner’s 
confidence  or  lack  thereof  into  their  own  decision-making, 
and  few  if  any  of  the  aforementioned  models  of  subjective 
confidence  can  explain  how  confidence  is  assessed  in 
others.  Suppose,  for  example,  that  you  ask  a  friend  what  she 
thinks  of  a  new  restaurant  that  has  opened  up  in  her 
neighborhood.  If  she  says,  “It’s  good!’’  her  intonation  may 
provide  a  cue  to  a  high  level  of  confidence  in  her  response. 
Alternatively,  if  she  hesitates  and  says,  “It’s... good...’’  then 
you  may  negate  the  material  content  of  her  response  and 
prefer  instead  to  explain  her  lack  of  confidence  as  indicative 
of  her  disapproval. 

In  the  present  investigation,  we  examined  how  individuals 
incorporate  their  partners’  levels  of  confidence  when  they 
assess  their  partner’s  explanations  of  a  confusing  scenario. 
Reasoners  could  modulate  their  acceptance  in  their  partner’s 
explanation  in  one  of  two  ways.  An  intuitive  prediction  is 
that  people  should  accept  an  explanation  more  often  when 
the  explanation  is  delivered  by  a  confident  partner  than  an 
uncertain  partner.  People  who  exhibit  this  behavior  should 
infer,  implicitly  or  explicitly,  that  the  partner’s  confidence  is 
proportional  to  the  explanation’s  credibility.  Preliminary 
support  for  this  prediction  comes  from  recent  studies  on  so 
called  “powerless  language’’,  which  show  that  statements 
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that  include  hedging  phrases  such  as  “sort  of’,  “kind  of', 
and  “probably”  are  rated  more  negatively  compared  to  non- 
hedged  statements  (Blankenship  &  Holtgraves,  2005;  Durik, 
Britt,  Reynolds,  &  Storey,  2008;  Liu  &  Fox  Tree,  2012). 
Hedges  may  provide  a  cue  to  a  low  level  of  confidence,  and 
therefore  cause  people  to  attenuate  their  belief  in  the 
statement. 

Alternatively,  if  people  prefer  explanations  when  they  are 
delivered  by  an  uncertain  partner,  then  it  may  be  because  the 
partner’s  uncertainty  provides  pragmatic  cues  to  the  strength 
of  the  explanation.  For  example,  an  uncertain  expressional 
cue  such  as  a  furrowed  brow  may  suggest  that  the  partner 
was  engaged  in  more  analytical  thinking  (Alter, 
Oppenheimer,  Epley,  &  Eyre,  2007),  and  an  analytical 
response  may  be  preferred  to  an  intuitive  one. 

In  what  follows,  we  report  two  experiments  that  tested 
whether  confidence  or  uncertainty  affects  explanatory 
credibility.  In  both  studies,  participants  engaged  in  a  dyadic 
interaction  with  a  pseudo-autonomous  humanoid  robot.  The 
robot  allowed  us  to  impose  stringent  controls  on  the  verbal 
and  expressional  cues  that  participants  received. 

Experiment  1 

Experiment  1  tested  whether  an  explanation  was  more  or 
less  acceptable  if  it  came  from  a  confident  or  an  uncertain 
confederate.  To  generate  systematic  social  interactions,  the 
experiment  called  on  participants  to  engage  in  a  dyadic 
interaction  with  a  pseudo-autonomous  robotic  confederate,  a 
humanoid  mobile,  dexterous,  social  (MDS)  robot  (Breazeal 
et  ah,  2008).  Participants  were  told  that  they  were 
interacting  with  the  robot  through  a  web-based  chat 
interface  (see  Figures  1  and  2).  Participants’  task  was  to 
read  a  problem  to  the  robot,  listen  to  the  robot’s  response, 
and  then  decide  whether  they  agreed,  did  not  understand,  or 
disagreed  with  the  robot.  If  they  did  not  understand,  or  else 
if  they  disagreed  with  the  robot,  they  verbally  explained 
their  reason  for  not  accepting  the  robot’s  response,  and  their 
verbal  protocols  were  recorded.  All  of  the  robot’s  responses 
were  pre-recorded,  and  we  manipulated  whether  the  robot 
delivered  its  responses  using  cues  of  confidence  or 
uncertainty. 

Method 

Participants.  38  native-English  speaking  undergraduates 
from  George  Mason  University  participated  in  exchange  for 
partial  course  credit.  None  of  the  participants  had  received 
any  training  in  logic. 

Procedure.  Participants  engaged  in  a  dyadic  interaction  with 
a  pseudo-autonomous  robotic  confederate.  Before  they 
began  the  study,  they  were  shown  a  video  of  humans 
engaged  in  natural  language  dialogue  with  an  MDS  robot 
(Hiatt  et  ah,  2011).  Participants  were  told  that  they  would 
interact  with  the  robotic  confederate  online,  but  that  the 
confederate  had  only  limited  abilities  to  comprehend  natural 
language,  and  that  the  confederate  would  be  unable  to 
respond  to  unrelated  questions.  In  actuality,  all  of  the 


robot’s  responses  were  pre-recorded.  Participants  were 
instructed  to  use  a  chat  interface  to  read  problems  to  the 
confederate  and  listen  to  the  confederate’s  responses.  The 
interface  was  written  in  Objective  C  for  an  iPad  tablet 
computer. 

The  experiment  began  when  the  confederate  introduced 
itself  as  “Lucas”,  an  MDS  robot,  and  waited  for  the 
participant  to  initiate  the  study  by  reading  the  first  problem. 
Figure  1  shows  a  schematic  of  the  interface.  Participants 
first  read  a  description  of  a  problem  to  the  confederate 
(Figure  la);  when  they  finished,  they  pressed  a  button  and 
listened  to  the  confederate’s  response  (Figure  lb);  when  the 
robot  finished  speaking,  the  participants  indicated  whether 
they  agreed  with,  did  not  understand,  or  disagreed  with  the 
robot’s  response  (Figure  lc);  finally,  if  they  disagreed  or  did 
not  understand  the  robot,  they  were  given  an  opportunity  to 
explain  their  disagreement  verbally  (Figure  Id),  and  they 
moved  on  to  the  next  problem. 


Figure  1.  A  schematic  diagram  of  the  chat  interface  used  for  the 
pseudo-interaction  in  Experiments  1  and  2. 

Design  and  materials.  Problems  consisted  of  a  conditional 
generalization  (1),  a  categorical  statement  (2),  and  an 
inferential  prompt,  e.g., 

1.  If  James  does  regular  aerobic  exercises  then  he 
strengthens  his  heart. 

2.  But,  James  did  not  strengthen  his  heart. 

3.  What,  if  anything,  follows? 

The  problems  invite  both  explanatory  (e.g.,  “James  had  a 
congenital  heart  defect”)  and  deductive  (e.g.,  “James  did  not 
do  regular  exercises”)  responses.  However,  people  tend  to 
elicit  explanations  for  such  problems  (Lee  &  Johnson-Laird, 
2006).  In  the  present  study,  participants  listened  to  and 
evaluated  the  confederate’s  explanation  of  ten  separate 
problems,  which  were  drawn  from  five  different  domains; 
biology,  economics,  mechanics,  psychology,  and  natural 
phenomena  (see  the  Appendix  for  the  full  set  of  materials). 
Explanations  were  adapted  from  reasoners’  most  frequently 
generated  spontaneous  explanations  in  studies  that  used 
similar  materials  (Khemlani  &  Johnson-Laird,  2012).  For 
each  explanation,  the  robotic  confederate  delivered  its 
response  using  a  verbal  cue  and  an  expressional  cue  to  its 
level  of  confidence.  Half  of  the  participants  received 
confident  verbal  and  expressional  cues,  and  the  remaining 
received  uncertain  cues.  The  explanations  in  both 
conditions  were  delivered  with  the  same  intonation.  Figure  2 


provides  examples  of  the  verbal  and  expressional  cues.  The 
materials  were  balanced  for  dieir  length  across  both 
conditions. 

Post-experimental  questionnaire.  Participants  who  perceive 
their  interaction  with  the  robot  as  staged  may  respond 
differently  than  those  who  believe  the  interaction  is  real.  To 
examine  factor,  participants  completed  a  post-experimental 
questionnaire  after  they  finished  the  experiment  proper.  Tire 
questionnaire  assessed  whether  the  participants  had  believed 
(erroneously)  that  they  were  interacting  with  an  autonomous 
robot,  or  whether  they  believed  (accurately)  that  the 
interaction  was  staged.  In  our  analyses,  we  present  data 
from  the  most  direct  question  they  answered,  which  was  as 
follows: 

"Did  Lucas 's  responses  seem  natural? 

1.  No,  his  responses  usually  looked  like  pre-recorded 
videos. 

2.  I’m  not  sure. 

3.  Yes,  he  usually  responded  like  a  human  would.  " 

After  participants  answered  the  questionnaire,  they  were 
debriefed  that  the  interaction  was  staged. 

Results  and  discussion 

Figure  3  show's  the  percentage  of  agreement  for  the 
explanations  as  a  function  of  the  confederate’s  confidence. 
Surprisingly,  participants  accepted  explanations  more  often 
when  the  confederate  was  uncertain  (75%  agreement)  than 
when  it  was  confident  (63%  agreement:  one-tailed  Mann- 
Wlritney  test,  z  =  1.75,  p  =  .04,  Cliff’s  6  =  .33).  hr  both 
conditions,  participants  accepted  explanations  signifi- 


Fignre  2.  Tire  interface  used  in  Experiments  1  and  2  (a).  The 
robotic  confederate  was  either  confident  (b)  or  uncertain  (c)  for  tire 
duration  of  the  study.  Confident  expressional  cues  included  wide 
open  eyes,  raised  eyebrows,  and  a  straight  mouth  orientation. 
Furthermore,  the  confident  confederate  preceded  its  responses  with 
confident  verbal  cues,  e.g.,  ‘’Oh,  I’ve  got  it!”  or  “That’s  easy.” 
Uncertain  expressional  cues  included  narrow  eyes,  half-cocked 
eyebrow's  (a  furrowed  brow  analog),  and  a  slanted  mouth 
orientation.  Uncertain  verbal  cues  included  expressions  such  as, 
“Hirurr,  that’s  a  tough  one”  and  “Huh,  I  don’t  know'  for  sure.” 


cantly  more  often  than  chance  (Wilcoxon  tests,  zs  >  2.25,  ps 
<  .02).  Their  agreement  varied  across  the  different  types  of 
materials  (Friedman  analysis  of  variance,  y2  =  49.9,  p  < 
.0001).  Across  the  study,  45%  of  the  participants  responded 
that  they  believed  the  interaction  wras  pre-recorded. 

To  assess  whether  the  effect  of  uncertainty  on  explanatory 
credibility  was  robust  across  the  different  materials,  w?e  fit 
the  data  to  a  generalized  mixed-effects  model  (Baayen, 
Davidson.  &  Bates,  2008)  with  a  binomial  error  distribution 
and  a  logit  link  function  using  the  lme4  package  (Bates, 
Maechler.  &  Bolker,  2012)  in  R  (R  Core  Team.  2012).  The 
model  took  into  account  a  single  fixed  effect,  i.e.,  the 
confederate’s  confidence,  as  well  as  three  additional  random 
effects:  the  participant  variance,  the  problem  variance,  and 
whether  or  not  the  participant  believed  that  the  interaction 
was  pre-recorded.  The  model  yielded  a  significant  main 
effect  of  confidence  (b  =  .77,  SE  =  .37.  p  =  .04).  The  results 
suggest  that  the  effect  held  whether  or  not  the  participants 
believed  that  the  interaction  wras  staged. 
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Figure  3. 

Agreement  percentages  for 
explanations  as  a  function  of 
whether  those  explanations 
were  delivered  by  a  confident 
or  an  uncertain  confederate. 
95%  confidence  intervals 
shown. 
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Confident  Uncertain 

Experiment  1  tested 
whether  reasoners  would  accept  explanations  more  or  less 
often  when  given  by  an  uncertain  confederate  compared  to  a 
confident  confederate.  However,  the  study  did  not  establish 
whether  the  effect  is  imique  to  explanatory  reasoning.  It 
may  be  the  case  that  the  effect  is  widespread,  and  that  it  is 
applicable  to  any  sort  of  inference,  not  just  to  the  evaluation 
of  explanations.  To  test  the  boundary  conditions  of  the 
effect,  participants  in  Experiment  2  evaluated  both 
explanations  and  deductions. 


Experiment  2 

Experiment  2  sought  to  replicate  the  effect  of  uncertainty 
on  explanatory  credibility,  as  well  as  to  test  whether-  it 
applied  to  any  sort  of  inference,  or  w'hether  it  was  localized, 
in  part,  to  explanatory  reasoning.  The  study  was  similar  to 
the  previous  one,  with  one  exception:  the  robotic 
confederate  in  the  present  study  provided  two  types  of 
responses,  either  an  explanation  or  else  a  deduction.  Recall 
that  the  problems  used  in  the  previous  study,  e.g.. 


Deduction 


Explanation 


If  James  does  regular  aerobic  exercises  then  he 

strengthens  his  heart. 

But,  James  did  not  strengthen  his  heart. 

What,  if  anything,  follows? 

invite  two  different  sorts  of  reasoning  strategies.  One  could 
construct  an  explanation  that  goes  beyond  the  information  in 
the  premises  (Khemlani  &  Johnson-Laird,  2011).  Or  else 
one  could  make  a  modus  tollens  deduction,  which  is  a 
logical  deduction  that  takes  the  following  abstract  form.  If  A 
then  B.  Not  B.  Therefore,  not  A.  The  inference  is  valid,  i.e., 
the  conclusion  is  true  whenever  the  premises  are  true,  but  it 
is  difficult  for  naive  reasoners.  Thus,  in  the  present  study, 
the  robotic  confederate’s  responses  concerned  either  an 
explanation  or  else  a  modus  tollens  deduction.  Half  of  the 
participants  interacted  with  a  confident  confederate  and  the 
other  half  interacted  with  an  uncertain  one.  If  the  effect  of 
uncertainty  on  credibility  applies  to  any  sort  of  response, 
then  there  should  not  be  an  interaction  between  the  type  of 
inference  and  the  confederate’s  confidence.  In  contrast,  if 
the  effect  is  unique  to  explanatory  reasoning,  then  there 
should  be  no  difference  between  participants’  evaluations  of 
confident  and  uncertain  deductions,  but  there  should  be  a 
difference  in  their  evaluations  of  explanations. 

Method 

Participants,  design,  and  procedure.  45  native  English- 
speaking  participants  were  recruited  though  the  same 
participant  pool  as  in  Experiment  1.  None  of  them  had 
received  training  in  formal  logic.  They  solved  ten  reasoning 
problems  by  engaging  in  a  web-based  chat  interaction  with  a 
pseudo-autonomous  robotic  confederate  (see  Figures  1  and 
2),  and  they  were  taught  to  use  the  interface  using  the  same 
procedure  as  in  the  previous  study.  Their  task  was  to  read 
each  problem  aloud  to  the  confederate,  listen  to  the 
confederate’s  response,  and  then  judge  whether  they  agreed, 
did  not  understand,  or  disagreed  with  the  response.  On  half 
of  the  problems,  the  confederate  would  produce  an 
explanation,  and  on  the  other  half,  it  would  produce  a 
deduction  (see  Appendix).  Twenty-three  participants 
interacted  with  a  confederate  that  produced  confident 
responses  and  the  remaining  interacted  with  one  that 
produced  uncertain  responses.  After  completing  the  last 
problem,  participants  filled  out  the  same  post-experimental 
questionnaire  that  was  described  for  Experiment  1. 


Figure  4.  Agreement  percentages  for  deductions  and  explanations 
as  a  function  of  whether  they  were  delivered  by  a  confident  or  an 
uncertain  confederate.  95%  confidence  intervals  shown. 


by  the  difference  between  confident  and  uncertain 
explanations,  and  the  data  yielded  a  significant  interaction 
between  the  type  of  inference  and  the  confederate’s 
confidence  (Mann-Whitney  test,  z  =  1.95,  p  =  .05,  Cliff’s  § 
=  .48).  The  results  suggest  that  the  effect  of  uncertainty  on 
credibility  applies  to  explanations  and  not  deductions.  As  in 
the  previous  study,  agreement  varied  as  a  function  of  the 
contents  of  the  problems  (Friedman  analysis  of  variance,  } [ 
=  43.49,  p  <  .0001),  and  58%  of  the  participants  reported 
that  they  believed  the  interaction  was  pre-recorded. 

To  assess  whether  the  effect  and  the  relevant  interaction 
were  both  reliable  across  the  different  materials,  we  fitted 
the  data  to  another  generalized  mixed-effects  model.  The 
model  took  into  account  two  fixed  effects,  i.e.,  the 
confederate’s  confidence  and  the  inference  type,  and  the 
three  pertinent  random  effects,  i.e.,  the  participant  variance, 
the  problem  variance,  and  whether  or  not  the  participant 
believed  that  the  interaction  was  pre-recorded.  The  model 
yielded  a  significant  main  effect  of  the  type  of  inference  (b 
=  -2.07,  SE  =  .36,  p  <  .0001),  however  it  yielded  no  main 
effect  of  confidence  (b  =  .05,  SE  =  .42,  p  =  .90).  Instead,  it 
yielded  a  significant  interaction  between  the  type  of 
inference  and  the  confederate’s  confidence  (b  =  1.07,  SE  = 
.54,  p  =  .045).  As  in  Experiment  1,  the  analysis  shows  that 
the  effect  held  in  spite  of  any  variance  from  the  different 
materials  or  the  perception  that  the  interaction  was  staged. 


Results  and  discussion 

Figure  4  presents  the  percentage  of  agreement  to 
deductions  and  explanations  as  a  function  of  whether  the 
response  was  delivered  by  a  confident  or  an  uncertain 
confederate.  Participants  agreed  with  deductions  almost  at 
ceiling  (87%)  and  accepted  them  reliably  more  often  than 
they  accepted  explanations  (63%;  Wilcoxon  test,  z  =  3.8,  p 
<  .0001,  Cliff’s  5  =  .55).  Likewise,  they  accepted  uncertain 
responses  more  often  than  confident  responses  (81%  vs. 
71%;  Mann-Whitney  test,  z  =  2.47,  p  =  .01,  Cliff’s  6  =  .43). 
However,  the  main  effect  of  confidence  was  driven  entirely 


General  Discussion 

We  used  a  novel  experimental  methodology  to  study  how 
reasoners  incorporate  metacognitive  information  to  judge 
one  another’s  explanations.  In  two  experiments,  reasoners 
interacted  with  a  robotic  agent  that  appeared  to  deliver  its 
responses  in  a  confident  or  else  an  uncertain  demeanor.  One 
might  expect  that  people  should  agree  with  confident 
explanations  more  often.  Yet  Experiment  1  showed  that 
participants  accepted  explanations  more  often  when  they 
came  from  an  uncertain  confederate  compared  to  a 
confident  one.  Experiment  2  tested  whether  the  effect  held 


more  generally  for  deductions,  but  it  found  instead  that  it 
was  limited  to  explanations. 

Why  do  reasoners  accept  explanations  more  often  when 
they  come  from  an  uncertain  source?  The  results  are 
counterintuitive,  particularly  since  confidence  is  correlated 
with  informational  accuracy.  Indeed,  at  first  blush,  the 
results  of  our  studies  conflict  with  recent  findings  on 
hedging  behavior  and  powerless  language  (Blankenship  & 
Holtgraves,  2005;  Durik,  Britt,  Reynolds,  &  Storey,  2008; 
Liu  &  Fox  Tree,  2012).  However,  we  hypothesize  that  one 
reason  for  a  speaker  to  produce  uncertain  expressions, 
gestures,  and  verbal  cues  is  to  signal  to  a  listener  that  the 
speaker  is  engaged  in  deeper  analytic  processing,  and 
furthermore,  that  the  speaker  is  considering  alternative 
possibilities.  This  proposal  accounts  for  why  the  effect  is 
manifest  for  explanations  but  not  modus  tollens  deductions: 
explanations  require  reasoners  to  think  about  multiple 
possibilities  and  to  go  beyond  the  information  presented  in 
the  premises,  whereas  modus  tollens  deductions  do  not.  If 
our  hypothesis  is  true,  then  we  should  a  similar  effect  of 
uncertainty  on  credibility  for  deductions  that  require 
reasoners  to  consider  multiple  possibilities  compared  to 
those  that  do  not. 

The  present  data  reveal  a  robust  credibility  effect  for 
human-robot  interactions,  and  critics  are  justified  in 
wondering  whether  the  effect  will  still  hold  in  dyadic 
human-human  interactions  (but  cf.  Moon  &  Nass,  1996,  for 
evidence  that  people  treat  interactive  computers  as  though 
they  were  human).  Similar  studies  with  human  confederates 
are  feasible,  but  the  human-robot  interaction  paradigm  we 
employed  has  several  advantages  to  traditional  studies  with 
human  confederates.  First,  robotic  confederates  can  be 
programmed  to  yield  very  precise  expressional  and  gestural 
cues  that  are  consistent  for  all  participants  in  the  study, 
while  even  the  best  human  confederates  are  susceptible  to 
irregular  behaviors.  Second,  robotic  confederates  can  be 
programmed  to  implement  complex  experimental  designs 
and  counterbalancing  schemes.  For  example,  the  software  in 
Experiment  2  was  written  so  that  exactly  half  of  the  robot’s 
responses  were  explanations.  Despite  these  advantages, 
however,  future  studies  should  examine  the  credibility  effect 
in,  albeit  less  controlled,  human  studies.  One  promising 
methodological  compromise  is  to  run  pseudo-dyadic 
interaction  studies  over  the  Internet  (Summerville  & 
Chartier,  2012). 

The  results  we  present  have  psychological  implications, 
as  well  as  implications  for  robotics  researchers.  A  major 
goal  for  the  interdisciplinary  community  of  human-robot 
interaction  research  is  to  develop  social  robots  that  humans 
trust  (Fong,  Thorpe,  &  Baur,  2001;  Goodrich  &  Schultz, 
2007;  Steinfield  et  ah,  2006).  The  credibility  effect  we  show 
implies  that  humans  are  likely  to  take  into  account 
metacognitive  signals  (and  their  robotic  analogs)  in 
assessing  information  from  autonomous  systems.  Research 
on  the  modulatory  effects  of  confidence  on  higher  order 
reasoning  is  of  multidisciplinary  relevance,  and  can  be 
applied  to  developing  broader  theories  of  confidence 


monitoring  in  humans  as  well  as  more  natural  and 
trustworthy  autonomous  robots. 
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Appendix.  The  problems  used  in  Experiment  1  and  Experiment  2,  which  consisted  of  a  conditional  generalization  (column  1) 
and  a  categorical  statement  (column  2). 


Premises  (spoken  by  the  participant  to  the  confederate) 

Responses  (spoken  to  the  participant  by  the  confederate) 

Conditional  generalization 

Categorical 

Explanation 
(Experiments  1  and  2) 

Deduction 
(Experiment  2) 

If  a  person  is  bitten  by  a  viper 
then  he  will  die 

However,  a  man  named 

Matthew  did  not  die 

Matthew  received  an 
antidote 

Matthew  was  not  bitten  by  a 
viper 

If  James  does  regular  aerobic 
exercises  then  he  strengthens  his 
heart 

But,  James  did  not  strengthen  his 
heart 

James  had  a  congenital 
heart  defect 

James  did  not  do  regular 
aerobic  exercises 

If  a  car's  engine  is  tuned  in  a 
special  way  then  its  fuel 
consumption  goes  down 

However,  one  car's  fuel 
consumption  did  not  go  down 

The  car  had  engine 
problems  that  increased 
consumption 

The  car's  engine  was  not  tuned 
in  the  special  way 

If  the  aperture  on  a  camera  is 
narrowed,  then  less  light  falls  on 
the  film 

But  in  one  instance,  less  light 
did  not  fall  on  the  film 

It  was  completely  dark,  so 
there  was  no  light  at  all 

The  aperture  on  the  camera  was 
not  narrowed 

If  a  person  pulls  the  trigger  on  a 
pistol,  then  the  pistol  fires 

However,  it  turned  out  that  the 
pistol  did  not  fire 

The  safety  had  not  been 
taken  off  the  pistol 

Nobody  pulled  the  trigger 

If  a  substance  such  as  butter  is 
heated  then  it  melts 

However,  one  piece  of  butter  did 
not  melt 

The  heat  was  too  low  to 
melt  the  butter 

The  piece  of  butter  was  not 
heated 

If  Chemical  A  and  Chemical  B 
come  into  contact  with  one 
another  then  there  will  be  an 
explosion 

But  there  was  no  explosion 

There  was  not  enough  of 
either  of  the  substances 

The  two  substances  did  not 
come  into  contact  with  one 
another 

If  a  person  receives  a  heavy 
blow  to  the  head  then  that  person 
forgets  some  preceding  events 

However,  Pat  did  not  forget  any 
preceding  events 

Pat  was  wearing  a  helmet 
at  the  time 

Pat  did  not  receive  a  heavy 
blow  to  the  head 

If  people  make  too  much  noise 
at  a  party  then  the  neighbors 
complain 

But  the  neighbors  did  not 
complain 

The  neighbors  were  away 
on  summer  vacation 

People  did  not  make  too  much 
noise  at  the  party 

If  the  banks  cut  interest  rates 
then  the  GDP  increases 

But  the  GDP  did  not  increase 

Cutting  rates  is  not  enough 
in  an  economic  decline 

The  banks  did  not  cut  interest 

rates 

